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Abstract 

We construct an orbifold model in which all the standard model particles are unified in 
a gauge multiplet in higher dimensional supersymmetric gauge theory. We find that a flavor 
symmetry has to remain in four dimensions due to the discrete charge conservation for orbifold 
conditions if the colored Higgs components in the gauge multiplet are projected out. When the 
flavor symmetry originates from the E 8 bulk gauge symmetry, the successful unification model 
can be constructed. In the model, all the Dirac Yukawa couplings for quarks and leptons are 
generated by the higher dimensional gauge interaction. 



1 Introduction 



The standard model (SM) is well established to describe the physics below weak scale. The- 
oretically, it is expected that there exists a model beyond SM. The conceptual motivation to 
consider the model beyond SM is to understand the variety of particles as well as the param- 
eters in SM. In fact, the content of particles in SM is a collection of widely disparate fields: 
gauge bosons coming in three factors (color, weak and hypercharge), three replicated families 
of chiral fermions (q, u c , d c , I and e c ), and a scalar Higgs boson to break electroweak symmetry 
and give masses to the chiral fermions. The Higgs scalar has a quadratic divergence in its mass 
squared, and thus the electroweak scale is not stable quantum mechanically if the cutoff scale 
is very high such as the Planck scale. Therefore, there must exist a theory beyond SM around 
the TeV scale. Besides, the masses and mixings of the fermions are generated by the Yukawa 
interactions with the Higgs boson, which are the most of the parameters in SM. In such a sense, 
the nature of the Higgs boson is a key ingredient to go beyond the standard model. 

Supersymmetry (SUSY) is one of the most promising candidates to construct a model 
beyond SM. The quadratic divergence of the Higgs boson mass squared is canceled due to 
the unification of couplings of fermions and bosons. Therefore, the electroweak scale is stable 
once it is generated, and the model at ultra high energy scale can be extrapolated from the 
weak scale physics. Although the particles get doubled naively in the SUSY extension, these 
new SUSY particles around the weak scale add an additional attraction in minimally extended 
SUSY standard model (MSSM). The measured three gauge couplings can be unified at a scale 
through renormalization group running. That provides us a motivation of grand unified theory 
(GUT) [lj that the gauge symmetry of the SM is unified in a simple group, such as SU(5) 
and SO (10). The quarks and leptons can be unified in a larger representation, especially in 
5*0(10) model. However, then the Higgs sector of the model becomes complicated. Naively, 
the Higgs doublet in SM is also unified in a larger representation. Then, there should be 
colored Higgs particles, which may cause a rapid proton decay rate rather than the current 
experimental bounds in SUSY GUT [2J. Therefore, the colored Higgs fields should be heavy, 
or their couplings to quarks and leptons needs to be forbidden. 

The idea of extra dimensions is attractive to build a model beyond SM [3 J . The extra dimen- 
sions are compactified, and the orbifold boundary conditions can be used to break symmetries 
|H El IS]- When it is applied in GUT models, the colored Higgs particles can be projected out, 
while Higgs doublet can be light as a four- dimensional (4D) zero mode. The proton decay op- 
erator via the colored Higgs fields is forbidden in the model |1] . Though the gauge symmetry is 
explicitly broken by the orbifold conditions, the gauge couplings can be unified when the brane 
localized gauge interaction is suppressed by a large volume of the extra dimensions [5] . In such 
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fashions, the idea of gauge-Higgs unification [7] is revived [8]. The scalar Higgs fields can be 
unified with the gauge fields in some higher dimensional vector fields. In a simple orbifold 
boundary condition, the gauge symmetry is broken since the broken generators of gauge bosons 
for 4D coordinates are projected out. At that time, the broken generators for extra dimensional 
components can have massless modes, and the Wilson line operator can be identified as the 
Higgs bosons to break the symmetry remaining in 4D [9]. Interestingly, this idea is compatible 
to extending the SM gauge symmetry to a larger gauge group like GUTs. Besides, the mass of 
the Higgs scalar is forbidden by gauge invariance, and thus it can remain at low energy when 
SUSY is combined in the model. 

The interesting consequence of the gauge-Higgs unification is that the Yukawa interac- 
tion can originate from the gauge interaction when fermions are also higher dimensional bulk 
fields [TTJJ, [11]. Actually, the 4D zero modes of fermions can be chiral in orbifold projections, 
and the higher dimensional extension of the fermion kinetic term with covariant derivative, 
iJl^id/i — igA^ip, include Yukawa coupling when the gauge fields with higher dimensional com- 
ponents are identified as Higgs fields. In the left-right symmetric construction of the model [12J, 
the matter representation to realize the gauge- Yukawa unification can be much simpler than 
that of the SM construction, and the actual unification of gauge and Yukawa coupling con- 
stants can be realized [llj. In the models of 5D M = 1 SUSY S l jZi orbifold with bulk gauge 
symmetries such as S'O(ll) and SU(8), which break down to Pati-Salam (PS) symmetry group 
Gps = SU(4) C x SU{2) L x SU{2) R [13] in 4D, matter fields are unified in hypermultiplets, and 
all three gauge couplings and third generation Yukawa couplings (top, bottom, tau and Dirac 
tau neutrino) can be unified. Actually, the prediction of the top quark mass can agree with 
the experiment if we take into account the threshold corrections [13]. If we say it inversely, we 
will be able to check if the unification of gauge and Yukawa couplings is realized in the future 
since the LHC and ILC experiments can provide us more accurate Yukawa couplings above 
TeV scale. It is important that the unification of the gauge and Yukawa coupling constants 
can be a signal of extra dimensions at ultra high energy scale. Therefore, we should investigate 
models in which gauge and Yukawa unification can happen. 

In SUSY extensions, the matter fermions can be unified in higher dimensional gauge multi- 
plets [151 EE [TT| , especially when the model consists of iV = 4 vector multiplet in 4D language 
such as in 6D M = (1, 1) SUSY. Interestingly, three replications of family can be obtained in 
the T 2 /Z 3 orbifold [16]. 

The hypermultiplet which is adjoint representation under the bulk gauge symmetry in 5D 
M = 1 SUSY S 1 /Z 2 orbifold model can be incorporated into the gauge multiplet in 6D M = 
(1,1) SUSY orbifold models. It is found that all matter species for one family and Higgs doublets 
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as well as gauge fields in SM can be unified in 6D Af = (1, 1) SUSY SU(8) gauge multiplets with 
T 2 /Z 6 orbifold [18J. The three gauge couplings and the third generation Yukawa couplings can 
be also unified in the model. Since no other bulk matter fields can be introduced, the model can 
explain why only third family is heavy. The other gauge groups [T9l [20] and other extensions 
including seven dimensional models [2TI [22] have also been considered. 

In Ref. [23] , we investigated the orbifold models in which three families of chiral fermions and 
Higgs fields, as well as gauge fields are the zero modes of the bulk gauge multiplet. When three 
families are the zero modes of the gauge multiplet, the dimension five proton decay operator 
will be dangerous if the colored Higgs fields are also the zero modes. The hierarchy of the 
Yukawa coupling for fermions is obtained from the Higgs doublet mixings in such models. If 
the colored Higgs fields couple with the first generation quarks and leptons by the bulk gauge 
interaction, the flavor suppression in the proton decay amplitude will not be applied. Then, 
the model will be ruled out even if the mass of the colored Higgs fields are of the order of 
the Planck scale. Therefore, one should project out the colored Higgs fields from the 4D zero 
modes, which is the original motivation of the orbifold GUTs. In this paper, we study the 
condition that the colored Higgs fields are projected out and the chiral families of fermions are 
kept to be zero modes. We find that a flavor symmetry has to remain in 4D to satisfy this 
condition. The symmetry is non-Abelian global or gauged flavor symmetry which originates 
from the R symmetry or bulk gauge symmetry. 

We study the phenomenological models with the bulk flavor symmetries. In the 6D SU(8) 
T 2 /Z^ orbifold model [24], there is a global SU(3) flavor symmetry in the bulk gauge interaction. 
As a result of the flavor symmetry, two eigenvalues are degenerate for the fermion masses from 
the bulk Yukawa coupling. Since the brane localized interaction is considered to be small by 
a volume suppression of the extra dimension, the second generation has to mix with brane 
localized field to build a phenomenological model. Then, the light linear combination of the 
second generation is almost the brane fields, and in that sense, all of the three generations of our 
fermions are not the zero modes of the bulk gauge multiplet. On the other hand, if the flavor 
symmetry originates from the E% bulk gauge symmetry, SU(4) flavor symmetry is possible. 
In this case, if we add one family of anti-chiral fermions as brane-localized fields, three-family 
model can be constructed. In the model, all the fields in SM are the zero modes of bulk gauge 
multiplet, and all the Dirac Yukawa couplings in SM originate from the bulk gauge interaction. 
The Yukawa hierarchy and the flavor mixings for quarks and leptons can be obtained from the 
Higgs mixings as well as the mixings with the fourth generation of the matter. 

This paper is organized as follows: In section 2, we introduce the orbifold models which we 
consider in this paper. In section 3, we obtain the conditions to project out the colored Higgs 
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fields and keep the chiral families to be the 4D zero modes. The flavor symmetry has to remain 
in 4D. In section 4, we discuss the possibility of the models with the bulk flavor symmetries. 
In section 5, we construct a phenomenological model with SU(4) flavor symmetry, in which all 
fields in SM are unified in the higher dimensional gauge multiplet. Section 6 is devoted to the 
conclusions. 

2 Gauge, Higgs and matter unification 

In this section, we will briefly study the higher dimensional orbifold model, which is used to 
construct a model where gauge, Higgs and matter fields are unified in the higher dimensional 
SUSY gauge multiplet [SI EE ED]. We will consider 10D J\f = 1 SUSY model to describe 
the theory generally, but 6D and 8D models can be also considered. We consider the extra 
dimensions are compactified over a flat T 2 /Z ni x T 2 /Z n2 x T 2 /Z n3 orbifold. The formalism of 
the higher dimensional models can be seen in Ref . [25j . 

From a 4D point of view, the 10D Af = 1 gauge multiplet is recognized as one N = 4 
multiplet which consists of one N — 1 vector superfield V and three chiral superfields £, (i = 
1, 2, 3). The scalar components of the chiral superfields S 1; S 2 , and S 3 are A 5 — iA e , A 7 — iA 8 , 
and A 9 — iA Wl respectively. We define the extra dimensional coordinates as z\ — x$ + ix$, 
Z2 = X7 + ix$, and z% = xg + ixi$. The orbifold transformations Rj are Zi — > uZi, where 
uj = e 2m l n i , The transformation Rj can also act on the internal symmetry of the Lagrangian. 
The internal symmetry in our class of models is the product of R symmetry and Aut(G). This 
extension of Rj can break SUSY as well as the bulk gauge group G. Depending on the discrete 
charge assignment, the 4D N = 4 SUSY can be broken down to iV = 0, 1, 2. 

If at least N = 1 SUSY remains in 4D, the orbifold conditions of the superfields V and $j 
are given as 



where Ri acts on the gauge algebra. Since there is a higher dimensional version of trilinear 
gauge interaction term in Lagrangian, fcj + li + m.i = (mod rij) needs to be satisfied. Also, we 
need k\ = 1, li = 1 and m 3 = 1 to make the lagrangian invariant. Therefore, one of (fcj,/j,mj) 
has to be 1. From a geometrical consequence, rij has to be 2,3,4,6. 

By the orbifold conditions, the gauge fields with broken generators are projected out, while 
the chiral superfields with the corresponding broken generators can have massless modes, which 



V^.uzi.uzi) 
£i(x M ,c^j,c^j) 
£ 2 (x M ,c^j,u;Zj) 

E 3 (x^,LJZi,UZi) 



RilVix^z^Zi)}, 



(1) 
(2) 
(3) 
(4) 



u ki R i [E 1 {x",z i ,z i )}, 
Q li R i [E 2 (x^,z i ,z i )}, 
u^Rifisix^z^Zi)], 
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can be identified to the matter and Higgs fields. Because the scalar components of the super- 
fields Sj are higher dimensional gauge fields, the bulk gauge interaction includes the term 
fabcT.IT, ^Eg in the superpotential in 4D, where f a b c is a structure constant of the gauge group. 
Therefore, if the matter and Higgs fields are zero modes from the gauge multiplet, the Yukawa 
couplings to generate the fermion masses can originate from the bulk gauge interaction. 

3 Projecting out the colored Higgs fields with family 
unification 

The broken generators for ADE gauge groups, such as SU(N), SO(2N), E e , E 7 and E 8 , often 
include the matter and Higgs representations under their subgroups. For example, when SU(8) 
bulk gauge group is broken down to SU (4) x SU (2) x SU{2) x U{\) 2 , one set of matter and Higgs 
representations are included in the broken generators [18]. In the case of E 8 — + E 6 x SU(3), 
the broken generator is (27, 3) + c.c, which can be identified to three families of matter and 
Higgs representations. The detail of the family unification is found in |23j . 

Suppose that the broken generators include the representations for two quark doublets qi,q2, 
which can be realized in SO(16) and E 7 [HI [20]. We also suppose that q± component in the 
adjoint representation is the zero mode in the superfield Si, and q2 component is the zero mode 
in T2. Namely, q\ and q2 components in Si and S2 have different discrete charges for orbifold. 
Then, because of the conservation of discrete charges for the broken generators and the relation 
ki + k + rrii = for the charge assignments of the superfields, zero modes of colored Higgs 
component he has to be in S 3 since gig2^c term is included in the cubic coupling of adjoint 
representation. When a lepton doublet i\ has zero modes in S3 in addition to the above, iiq2hc 
term is automatically included in the bulk gauge interaction of the zero modes. Those colored 
Higgs couplings are dangerous for a rapid proton decay once the colored Higgs fields form a 
Dirac mass term. Actually, the coupling constant is the same as the gauge couplings, the usual 
flavor suppression may not be applied to the decay amplitude, and it will be excluded even if 
the colored Higgs mass is of the order of the Planck scale. If more than two quark doublets 
have zero modes in the gauge multiplet, we have to care about the dangerous colored Higgs 
couplings. 

Original motivation of the orbifold GUTs is projecting out of the colored Higgs fields by 
the orbifold conditions [4J. In what cases is it possible to project out the colored Higgs fields 
keeping the generations of matter fields as zero modes? Surely, when he is projected out by 
choosing the discrete charges in the above example, one of q± and g 2 is also projected out due 
to the discrete charge conservation. 
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The possibility is the following two cases: 

1. The broken generator component qi is the zero mode in the superfield S 1; and the same 
component qi is also the zero mode in £2. 

Since the cubic term of the adjoint representation is tr [Ei, E2]E3, the symmetric term q\q\hc 
is not included. Therefore, the zero mode of he component is not included in E3 in this case. 
To realize this situation, E x and E 2 have to have the same discrete charge fcj = U. As a result, 
the zero modes interaction from the bulk cubic term has a global non-Abelian flavor symmetry. 
The global symmetry originates from the R symmetry in the bulk SUSY. 

Three flavor model in this case is already studied in SU(8) 6D T 2 /Z 3 orbifold model [24|, 
where all £1, E 2 , S 3 have the same discrete charges ki = U = rrii. Note that the SU(S) adjoint 
includes only one generation of matter, and colored Higgs representation is not included under 
the broken symmetry SU(4) x SU(2) x SU(2) x U(l) 2 . Similar T 2 /Z 3 orbifold projection can 
be done even in the case where more than two generations are in the adjoint representation of 
bulk gauge symmetry, e.g. SO(16). In those cases, only one of the components of quark doublet 
has the zero modes, and the generations in 4D are replicated by the three chiral superfields. 

2. Both qi and 52 components are the zero modes in the same superfield Ei. 

The qi and q2 components have the same discrete charges in this case. Since the bulk 
interaction is EXE2E3, the colored Higgs component can be projected out keeping the generation 
unless the set of q\ and 52 components are also in £2. In this case, the generation of fermions 
comes from the gauge part, and the gauged non-Abelian flavor symmetry remains in 4D. 

Due to the conservation of discrete charge, only the above cases are allowed. As a result, 
there must be a non-Abelian flavor symmetry when more than two generations of quark doublets 
are included in the zero modes of the bulk multiplets and the colored Higgs component h c is 
projected out. 

The 4D gauge symmetry is further restricted in order to project out the colored Higgs 
components. Suppose that the 4D gauge symmetry is the SM gauge symmetry, and more 
than two generation of quark doublets q^ and the lepton doublets £j have zero modes in the 
superfields. Then, q^ and £j have to be slotted in different superfields, and qihe term is included 
in the bulk interaction of the zero modes. If he is projected out in that situation, qi or £j has to 
be projected out as long as the bulk gauge symmetry is broken down to SM gauge symmetry. 
When both q^ and £j components have zero modes in the same chiral superfields, the colored 
Higgs term is not included in the bulk interaction of the zero modes. At that time, at least, 
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SU(4) c [d SU(3) c x U(1)b-l] gauge symmetry must remain in 4D since (q, £) forms a 577(4) c 
multiplet. Similarly, due to the terms of u c d c hc + e c u c hc + d c u c hc, when the colored Higgs 
fields are projected out completely and the 4D symmetry is SM gauge symmetry, only part of 
the matter species (e.g. q and u c ) can be the zero modes. In other words, if all of the matter 
species (including right-handed fermions, u c , d c , e c , v c ) with generations are the zero modes of 
the bulk multiplet, and the colored Higgs components (both he and he) are projected out, at 
least Gps = S77(4) c x SU{2) L x SU{2) R gauge symmetry must remain in 4D. 

If one consider a gauge symmetry which contains Gps (e.g. SU(6) x SU(2) L or 5*0(10)), 
the colored Higgs components is unified to the matter representations or the Higgs doublet 
component. Therefore, the Pati-Salam symmetry Gps is the basic building block for the 4D 
gauge symmetry to project out the colored Higgs fields. 

4 Models with the bulk flavor symmetries 

In the previous section, we have found that gauged or global flavor symmetry remains in 4D 
for the bulk Yukawa interaction when the generations of matter contents are the zero modes of 
the gauge multiplet. If both left- and right-handed matter representations are the zero modes 
in the 4D gauge symmetry Gps, the Higgs bidoublet is also the zero modes due to the discrete 
charge conservation. Then, the Yukawa couplings to generate the fermion masses originate 
from the bulk gauge interaction. However, there is a problem in this scenario. When there is 
a non-Abelian flavor symmetry, two eigenvalues of the fermion masses are degenerate due to 
the anti-symmetricity of the bulk Yukawa interaction. We consider that the brane-localized 
couplings are suppressed due to the large volume suppression of extra dimensions. Then, 
the bulk Yukawa couplings originated from the gauge interaction dominates the 4D Yukawa 
couplings. Therefore, the degeneracy of the fermion masses cannot be solved by the brane 
interaction of the zero modes, and the model is not phenomenologically viable. 

In order to solve the degeneracy of the fermion masses, brane-localized vector-like matter 
fields are introduced [24]. In this resolution, however, the second generation matter fields are 
almost switched with the brane-localized fields. Therefore, the Yukawa coupling for the second 
generation does not originate from the bulk gauge interaction, but from the brane-localized 
interaction. In the sense, this resolution does not provide a complete unification scenario of 
the gauge, Higgs and matter fields as well as the Yukawa couplings, although the three chiral 
matter fields can be zero modes of the bulk gauge multiplet. Actually, the second generation 
of matter has to be always replaced with the brane fields as long as the number of the matter 
replication is three and the Yukawa matrix is anti-symmetric. 

If there are four times replication of bulk matter fields, the degeneracy can be resolved 
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without replacing them with the brane fields. Consider ££7(4) flavor symmetry. In this case, 
the eigenvalues are also degenerate due to the anti-symmetricity of the bulk interaction. When 
we introduce one generation of anti-chiral matter brane fields, one linear combination of the 
four generations become massive by forming a Dirac mass. At that time, since the brane field is 
anti-chiral, it is not mixed with the bulk matter fields. Due to the mixing with the brane field 
(breaking of the £77(4) symmetry), the anti-symmetricity of the fermion mass matrix is resolved, 
and the hierarchical pattern can be obtained. In this situation, the complete unification scenario 
can be realized : All the particles in SM are the zero modes of the bulk fields and all the Dirac 
Yukawa couplings originate from the higher dimensional gauge interaction. Effective Yukawa 
couplings for fermions in the standard models are the gauge coupling multiplied by the mixings 
with the heavy 4th generation. 

If the flavor symmetry is global originating from the R symmetry, the maximal symmetry 
is £77(3) because there are only three chiral superfields. Therefore, to realize the flavor £77(4) 
symmetry, it has to originate from the bulk gauge symmetry. Only possibility of the bulk gauge 
symmetry which include Gps and £77(4) flavor symmetry is E%: 

E 8 -> £0(10) x SU(A) F -> SU(A) C x SU(2) L x SU(2) R x SU(A) F . (5) 

The corresponding breaking of E$ can be done by T 2 /Z& x T 2 /Z' 4 orbifold. 

The discrete charge assignments for the Gps decomposition of the E$ adjoint representation 
are the following [23] : 

[0] : (15, 1, 1), (1, 3, 1), (1, 1, 3), [e] : (6, 2, 2), [x t - Xj ] : A\, (6) 

[Xi] : Li, [e + Xi) : R h : V, [e - a*] : R\ (7) 

[x{ + Xj] : C{j, [e + Xi + Xj] : Hij, (8) 

where and Ri are the matter representations, is the Higgs bidoublet, and C^- is the 
SU(4) C sextet which contains the colored Higgs representations, 

U: (4,2,1,4), R\: (4,1,2,4), H {j : (1, 2, 2, 6), Qj : (6, 1, 1,6), (9) 

L and R are the anti-chiral matter representations, and A\ is the adjoint of SU(A)p- Due to 
the algebra, the followings have to be satisfied: x\ + x 2 + x 3 + x 4 = and 2e = 0. 
When we choose the discrete charges as 

(x 1 ,x 2 , x 3 , Xi, e) Z4 = (1, 1, 1, 1, 2), (xi, x 2 , x 3 , x 4 , e) z > 4 = (1, 1, 1, 1, 0), (10) 

and the assignments for chiral superfields as 

(h, h, mi) = (1,3,0), (k 2 ,l 2 ,m 2 ) = (1,1,2), (11) 
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the 4D gauge symmetry is Gps x SU(4) p and Lj, Ri, and ify have zero modes in Si, S 2 , and £ 3 , 
respectively. The bulk gauge interaction includes the Yukawa terms e^ kl L i RjHi : i = LiRjH^ . 

We comment briefly on the brane- localized gauge anomalies [26j. The 4D zero modes cause 
the gauge anomaly for SU(4)p symmetry. In order to cancel the anomaly, we have to introduce 
brane-localized fields at each 4D fixed point. When there is 16 anti-fundamental representations 
or 2 anti-decuplets, the SU(4)p anomaly is cancelled. The anti-decuplets can be used to 
generate Majorana neutrino masses. The SU(4)p sextet do not generate the anomaly. 



5 Building a phenomenological model 

In this section, we will construct a model in which all Dirac Yukawa interaction originates from 
the bulk gauge interaction using the Gps x SU (4) p symmetry obtained in the previous section. 

The Higgs bidoublet field is sextet under the flavor symmetry SU(A)p. When we 
introduce brane fields hi : (1,2,2,4) and h : (1,2,2,1), only one of linear combinations of 
bidoublets can become light (6 — 4 — 1 = 1). The required brane-localized mass terms are 



SijH %3 h + SiW J h 



'12) 



where Sy and Sj are SU (4) F sextet and fundamental representations, respectively. When those 
SM singlets acquire vacuum expectation values (VEVs), the SU(4)p symmetry is completely 
broken. The VEV (s y ) breaks SU(4) F down to 577(2) x SU(2), and (s f ) breaks SU(2) x SU{2) 
to nothing. 

We introduce anti-chiral brane fields Lb : (4, 2, 1, 1), and Rb : (4, 1, 2, 1), and brane terms: 



LiLbS 1 + RiRbS 1 



(13) 



where s l is an anti-fundamental representation under SU(4)p. We introduce multiple s l, s, and 
the fields s l which couples to the right-handed matter Ri can have a SU(2)n breaking VEVs. 
Then, the fermion mass term is expressed as 



(Li, L 2 , L 3 , L4, Rb 



m 



TUij 



\ Mi M 2 M 3 M 4 

/ 








\ 


/ ^1 


\ 







R2 









R 3 




M 5 











/ 


V L b 


J 



(14) 



c \ 

6 

-6 a 

\ -c -a / 



(15) 



9 



where Mj comes from the VEVs of s l , and a, b and c are weak scale VEVs of Higgs bidoublets 
(multiplied by 4D gauge coupling): e.g. a 2 + b 2 + c 2 = g 2 v\ for up-type quark mass matrix, 
where v u is the VEV of the up-type Higgs field H u . By SU (4) F rotation, we can choose that 
(1,5), (2, 5), (3, 5) elements in the mass matrix are zero keeping rriij to be anti-symmetric. By 
the remaining SU(3)p rotation, (1,2), (1,3), (2, 4) components can be made zero. Note that only 
one linear combination of the Higgs doublets is light, and the ratios c/a and b/a are related to 
the Higgs mixings. 

The scale of Mj relates to the SU(4)p breaking, and one of linear combinations of four 
matter fields becomes massive, and three generations of matter remain light. Using a unitary 
matrix U where (M 1; M 2 , M 3 , M^)U = (0, 0, 0, M), the light fermion's mass matrix is obtained 
as Aiij = (mU)ij = 1, 2, 3). The unitary matrix can be parameterized as 



U 



( cos 9i 
sin^i 


V o 



— sin 8i 
cos 6*i 







\ 



1 
1/ 



/ 1 o 

cos 6*2 

sin 6 2 
\ 





— sin 62 
cos 6*2 




0\ 




1 / 



/ 1 

1 

cos # 3 

\ sin# 3 






— sin # 3 

cos # 3 



\ 



/ 



(16) 



where tanfli = M 1 /M 2 , tan6» 2 = y/Mf + M$/M 3 , and tan# 3 = yjM\ + M| + M|/M 4 . The 



3x3 fermion matrix Aia can be calculated as 



M = (mil) 



3x3 



/ 

V 



o 
o 

-b sin 9i 





b sin 82 



c sin #3 
b cos 6*2 cos 6*3 



(17) 



-b cos 6*i cos 6*2 b cos 9\ sin 9 2 cos 9 3 + a sin 3 j 



If SU(2)r breaking VEVs are not inserted in the Higgs bidoublet mass terms in Eq. f|T2|) . 
a, b, c are common for up- and down-type quarks (up to tan f3 factor), but the mixing angles #1,2,3 
can be different between up- and down-type quarks by the SU{2)r breaking insertion in Eq. (|13p . 
and the quark's generation mixings can be generated. The dimensionful parameters a and c 
can be made real without loss of generality, and the phase of b can introduce the Kobayashi- 
Maskawa phase. Therefore, in this case, there are totally 9 parameters (+ 1 complex phase) 
in the light quark mass matrices in the model. In general, the SU(2)r breaking VEVs can be 
inserted in the Higgs bidoublet mass terms as well as the matter mass terms, and so there can 
be more parameters. 

We note that if only one s l couples to the matter fields, M 12 ,3 entries become zero in the 
above basis. Then, the anti-symmetricity of the light fermion mass matrix is kept and the mass 
degeneracy is not resolved. When more than two s J, s couples to the matter fields (and left-right 
parity is broken in the brane- localized terms), the degeneracy can be resolved. 
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The mass eigenvalues m 12) 3 have relations: 



2 i 2 i 2 

m x + m 2 + m 3 



m 1 m 2 m 3 



— 6 2 c sin sin 6> 2 sin 6*3, 

(a 2 + c 2 ) sin 2 9 3 + 6 2 (1 + cos 9\ + sin 2 0! sin 2 9 2 sin 2 3 ) 



(18) 
(19) 



+ab cos 6*i sin 9 2 sin 20 3 , 



2 2 1 2 2 1 22 
m l m 2 + m 2 m 3 + m l m 3 



b 2 [(a 2 sin 2 2 + c 2 (l + sin 2 9 1 sin 2 2 )) sin 2 9 3 
+6 2 (cos 2 3 + sin 2 9\ sin 2 2 sin 2 3 ) + ab cos 0i sin 2 sin 20 3 ] . 



(20) 



There are typically three cases to obtain hierarchical eigenvalues: 

1. b,c <^ a. 

2. c < a ~ 6. 

3. & <C a ~ c. 

In the case 1, the eigenvalue of the third generation is m 3 ~ asin0 3 , and thus the Yukawa 
coupling for the third generation can be written as y 3 ~ gsin6> 3 . In this case, the third 
generation Yukawa coupling is always smaller than (or equal to) the 4D gauge coupling g. 
Therefore, tan (3 is naively a function of sin 9 3 for down-type quark sector. 

In the case 2, it is necessary that cos# 3 and sin^ 2 are small to obtain the hierarchy between 
second and third generation. The eigenvalue of the third generation is then m 3 ~ \Ja? + b 2 and 
the third generation Yukawa coupling is unified to the gauge coupling y 3 ~ g. Since bottom 
Yukawa coupling is large, tan (3 has to be large ~ 50. 

In the case 3, the third generation Yukawa coupling is y 3 ~ g sin 9 3 similarly to the case 
1. The second generation mass eigenvalue is m 2 ~ 6a/ (a 2 sin 2 9 2 + c 2 )/(a 2 + c 2 ). The factor 
sin 9\ sin 9 2 has to be small to obtain a small mass for the first generation. Therefore, if the ratio 
of a, b and c are same for up- and down-type quarks (which can be realized when the insertion 
of SU(2) R breaking VEVs in the Higgs doublet mass term is small), the Yukawa couplings for 
charm and strange quarks are almost same (especially when asin# 2 c). As a result, tan/3 
has to be related to the charm-strange quark mass ratio (tan/3 ~ 5 — 15). 

The quark mixings can be generated especially in the case 2. The detail of the mixings is 
noted in Appendix. The naive relations V c b ~ m s /mb and V u b ~ V us V c b are naturally satisfied 
when sin 9 2 is small. The Cabibbo mixing angle is naively ~ (c/6) tan# 3 / cos6> 2 - Therefore, the 
Cabibbo angle become relatively large when cos# 3 — > 0, which is related to the condition that 
the third generation Yukawa coupling constant is the same as the gauge coupling constant, and 
the second generation Yukawa coupling is relative small. 
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The suitable choice of parameters can be obtained when Mi, M 2 , M 4 <C M 3 . In that case, one 
can interpret that M 3 and M 5 break the 577(4) p symmetry down to SU(2) symmetry, and the 
other quantities Mi, M 2 break the remaining SU(2) symmetry to obtain the fermion hierarchy. 
The CP symmetry in the quark mass term is spontaneously broken and the Kobayashi-Maskawa 
phase is obtained from the VEVs of s\ 

All the Dirac Yukawa couplings for fermions originate from the gauge interaction, but the 
Majorana couplings for neutrinos are introduced by brane- localized interaction. Thus, there 
are many numbers of parameters when Gps symmetry is broken, and the neutrino mixings 
are less constrained compared to the quark mixings. To generate the Majorana masses for 
neutrinos, we need a S77(4) p anti-decuplet or (at least) four anti-fundamental representations 
which couple to the matter fields. 

We comment briefly on the SU(4)p symmetry breaking scale. The exchange of the SU(A)p 
gauge bosons gives rise to flavor changing neutral currents, and thus the breaking scale has to 
be much larger than the weak scale in order to suppress unwanted effects [27] . The Lagrangian 
has a Peccei-Quinn-like symmetry, and the S77(4)^ breaking scale (VEVs of s l ) is related to the 
Peccei-Quinn-like symmetry breaking. The Peccei-Quinn symmetry breaking is also related to 
the Majorana mass scale for the right-handed neutrinos. The strong CP problem can be solved 
in this framework when the Peccei-Quinn symmetry breaking scale is 10 12 GeV [28], similar 
to the models with SU(3) horizontal symmetry [29]. To generate fermion mass hierarchy, the 
SU(4)p will not break at a single scale, and thus the Peccei-Quinn and SU(4)f symmetry 
breaking scales may have a difference relating to the fermion hierarchy. At the mass scale of 
the vector-like fourth generation, the Peccei-Quinn-like symmetry can still remain, and thus 
the mass of the fourth generation is expected to be larger than the axion scale. 

6 Conclusion 

We studied the higher dimensional models in which gauge, Higgs and families of chiral fermions 
are unified in a SUSY gauge multiplet. The Yukawa couplings to generate the fermion masses 
originate from the bulk gauge interaction. 

When the first generation of fermions are the zero modes of the bulk fields and the zero 
modes of the colored Higgs fields couple to them by the bulk gauge interaction, it causes the 
rapid proton decay. Thus, we should project out the colored Higgs components in the bulk 
gauge multiplet. When the colored Higgs fields are completely projected out by the choice 
of the discrete charge assignments for the orbifold condition and the families of the chiral 
fermions are the zero modes from the bulk gauge multiplet, there must remain a non-Abelian 
flavor symmetry in 4D. The flavor symmetry originates from the R symmetry or the bulk gauge 
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symmetry. 

When there is a flavor symmetry in the bulk Yukawa interaction, the fermion mass eigenval- 
ues are degenerate. Since we expect that the brane interactions are suppressed, the degeneracy 
should be resolved by introducing the brane-localized fields. When there is a SU(3) flavor 
symmetry and three chiral families are the zero modes of the bulk gauge multiplet, one of the 
families are (almost) switched with the brane fields to resolve the mass degeneracy. In this 
case, there is a merit that the second and third generation hierarchy is obtained by the volume 
suppression of the extra dimensions, and the lightness of the first generation is obtained by the 
exponential suppression of the Wilson line operators [23]. It is conceptually interesting that the 
replication of three families are caused by the three chiral superfields in the gauge multiplet. 
When there is a S77(4) flavor symmetry and four chiral families are the zero modes, the mass 
degeneracy can be resolved by introducing one anti-chiral family. In this case, all three gen- 
erations of the quarks and leptons, Higgs fields and the gauge bosons contained in SM can be 
successfully unified in one gauge multiplet. All the Dirac Yukawa couplings originate from the 
bulk gauge interaction, and the effective Yukawa couplings in SM to generate the hierarchical 
fermion masses and the generation mixings are obtained from the mixings of the Higgs doublets 
as well as the mixings with the heavy fourth generation. The 577(4) flavor symmetry has to be 
a gauged symmetry which originates from the bulk Eg gauge symmetry, and the model is more 
restricted rather than the case of SU (3) flavor symmetry. 

In conclusion, a flavor symmetry has to remain in 4D in the family unified orbifold GUTs if 
the colored Higgs components are projected out from the 4D zero modes. If the flavor symmetry 
is 577(3), the fermion hierarchy can be explained by the suppressions from extra dimensions. 
If the flavor symmetry is S77(4) originating from the bulk Eg gauge symmetry, the hierarchy 
is obtained by the 577(4) breaking patterns, and all the Dirac Yukawa couplings to generate 
fermion masses are introduced by the higher dimensional gauge interactions. 



Appendix: Note on the diagonalization unitary matrix 



We obtain the diagonalization unitary matrix V (VMMW' 
M is written in the form of 



M 



qy 
w py 

u v x 



\ 



J 



M|j ) when the mass matrix 



(21) 



as in Eq. (117p . Since the mass matrix can be always made to be in the above form by an 
unphysical unitary matrix from the right-hand side, the expression below will be useful in 
general. We define p 2 + q 2 = 1 to make the expression simple. We assume y,w <C x,u,v and 
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q <C 1. Without loss of generality, only w has a complex phase. 
When w = 0, one can obtain the exact diagonalization matrix as 





I 


1 












/ 


p 


-Q 





\ 


V = 







C23 


— s 23 








Q 


P 









V 





S23 


C23 


) 




\ 








1 


/ 



a: 2 + u 2 + f 2 



(22) 



The 13 element of V is 



where s 2 3 = sin #23, c 2 3 = cos #23 and tan2# 2 3 
exactly zero. Suppose that the above mass matrix is for the down-type quarks and the up- 
quark mass matrix is already diagonalized in the basis. Then the CKM (Cabibbo-Kobayashi- 
Maskawa) quark mixing matrix is Vckm = V^, and we obtain V u (, = qs 23 . Therefore, the limit 
is suitable to understand the empirical relation V uh ~ V us V c b- The strange-bottom quark 



w 



mass ratio is obtained as m s /m h ~ V^v/x in the limit, and thus the suitable relation between 
the ratio and V c b can be obtained when v ~ x. 

When w^O, the diagonalization matrix is obtained approximately as 



V ~ 



( C12 

V 



-S12 \ 
C12 
1 




(\ 

c 23 
\ s 23 





-•§23 
C23 



/ 



P 

Q 



-Q 
P 








(23) 



where tan 26> 2 3 



2(xy + pvw) 
X 2 + V? + v 2 — ' 



-, and 



s l3 ~ -gw(c 23 w + s 2 3pw)/ml, s 12 ~ qw(s 2 3V - c 2 zpw)/m. 



and ml ~ y 2 + w 2 — j tan 2 2^ 23 r?7.§, m| ~ -u 2 + v 2 + x 2 . Then, we obtain 



V21 ~ g + psi2, V31 ~ gs 2 3 + PS13, V 3 



32 



PS 23 - 



(24) 



(25) 



Here we do not consider the phase of w to make the expression simple, but the extension 
including the complex phase can be easily done. We note that when the correction from w is 
small, the Kobayashi-Maskawa phase cannot be large since only w can have a physical complex 
phase. Actually, the experimental measurement gives V u b/ (V us V c b) — 0.5, and there has to be 
a correction from w. When w is large enough to modify the relation, the proper range of down 
quark mass can be obtained. 

When m,!j«i and m 2 ~ w, Si 2 is comparable to q and V\ 2 is cancelled to be small. At 
that time, the expression above is not a good approximation. In that case, V13 ~ qy/x and 
V12 — —qvy/{wx). 

We note that the neutrino mixings are large if u ~ v ~ x and the charged-lepton mass 
matrix is transpose of the down-type quark mass matrix, which can be naively realized in 
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SU(5) GUTs. If the neutrino mass matrix is diagonalized in this basis, the neutrino mixing 
matrix is V* (instead of V^) and thus the 13 element of the mixing matrix (U^) is naturally 
small in the limit w — > 0. Therefore, the basis is useful to see the mixings of quarks and leptons. 
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